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A) .  SHOCK  AND  WEAR  PROCESSES. 

A  device  is  subject  to  shocks  causing  damage.  Let,  X  denote  the 
cumulative  damage  the  device  suffers  during  the  interval  (0,t]  plus  the 
initial  damage  at  time  0.  It  is  clear  that  this  will  be  a  right  continuous 
and  increasing  stochastic  process.  Every  jump  of  this  process  has  the  inter¬ 
pretation  of  being  the  damage  due  to  a  shock  at  the  time  of  the  jump.  Assume 

that  X  is  a  nonstationary  Levy  process.  The  Poisson  random  measure 

generating  the  Levy  process  and  describing  the  shock  times  and  their  damage 

magnitude  has  a  mean  measure  v(dt,dz)  of  the  form  A(dt)y(dz);  /  (zAl)p(dz)  <  00 . 

R0 

This  process  is  assumed  to  be  defined  on  some  probability  space  (ft,F,P).  The 
device  has  a  certain  threshold  Y  defined  on  another  probability  space 

(ft,F,P).  The  device  fails  when  the  damage  first  exceeds  the  threshold.  The 

failure  time  Z,  defined  on  ft  x  ft'  according  to  the  following: 

Z (w,w')  = inf {t > 0:Xt (w) > Y(w') }.  Let  G(y)  be  the  probability  that 
threshold  Y  exceeds  or  equal  to  y,  y^O.  Then  for  t  >  0  and  x  >  0  the 

survival  probability  F  (t)  is  given  by  F  (t)  =  E  f G (X  )]. 

Then,  the  following  holds: 

i)  if  G  has  increasing  failure  rate  and  A  is  convex  and  p < <  ]eb. 

with  density  f  that  is  a  Polya  frequency  function  of  order  two.  then  F^(t) 

has  increasing  failure  rate  for  each  x>0; 

ii)  if  G  has  a  decreasing  failure  rate  and  A  is  concave,  then  F^ 

has  a  decreasing  failure  rate  for  each  x^O; 
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iii)  if  G  has  increasing  failure  rate  average  and  A  is  starshaped; 
then  F^  has  increasing  failure  rate  average  for  each  x^O; 

iv)  if  G  has  decreasing  failure  rate  average  and  A  is  antistarshaped 
p<<  leb.  with  PF^  density,  then  F^  has  decreasing  failure  rate  average 
for  each  x>0; 

v)  if  G  is  better  than  used  and  A  is  superadditive,  then  for  each 
x  £  (0,1)  and  x,t,s^0;  we  have 


F  (t  +  s)  <F  (t)F . ,  ,  (s) 

x  ctx  (1  -  a)x 


In  particular  F^  is  new  better  than  used. 

vi)  if  G  is  new  worse  than  used  and  A  is  subadditive,  then  F  is 

x 

new  worse  than  used . 


Moeover,  when  G  depends  both  on  the  accumulated  damage  and  time  then 
the  following  holds: 

i)  if  the  map  x-*G(x,t)  has  increasing  failure  rate  average  for  each 
t>0,  the  map  t-*G(x,t)  is  decreasing  for  each  x^O,  and  A  is  starshaped, 
then  F  has  increasing  failure  rate  average  for  each  x^O; 


ii)  if  the  map  x->-G(x,t)  has  decreasing  failure  rate  average,  the  map 
t->-G(x,t)  is  increasing  for  each  x^O,  A  is  antistarshaped  and  p<<  leb. 
with  PF,  density,  then  F^Ct)  has  decreasing  failure  rate  average  for  each 
x>0; 

iii)  if  the  map  (x,t)  -*•  G(x,  t)  satisfied  G(x  +  y , t  4-  s)  <  G(x , t )G(y  ,s) 
for  each  x,y,t,s^0,  A  is  superadditive,  then  for  each  x,t,s^0  and 


a  e  (0 , 1 )  we  have 


In  particular  Fq  is  new  better  than  used. 

iv)  if  the  map  (x,t) G(x,t)  satisfies  the  property 

G(x  +  y,t  +  s)  ^  G(x,t)G(y,s)  for  each  x,y,t,s>0  and  A  is  subadditive, 

then  F  is  new  worse  than  used  for  each  x^O. 
x 

B).  OPTIMAL  MAINTENANCE  AND  REPLACEMENT  POLICIES. 

Suppose  that  a  device  is  subject  to  shocks  causing  damage.  Damage 
accumulates  and  the  accumulated  damage  can  be  described  as  a  Levy  process  with 
man  measure  v(dt,dz)  of  the  form  dty(dz).  This  simply  means  that  the 
process  has  stationary  independent  increments.  Assume  that  the  device  can  be 
replaced  before  or  at  failure.  Replacements  at  failure  costs  c  dollars.  If 
the  device  is  replaced  before  failure  a  smaller  cost  is  incurred.  The  cost 
depends  on  the  accumulated  damage  at  the  time  of  replacement,  and  is  denoted 
by  c(.).  Let  X  denote  the  accumulated  damage  till  time  t.  For  any 
Markovian  replacement  policy  t,  the  average  cost  per  unit  time,  ^  is  of 
the  form: 

iJj  (x)  =  (E  [c(x  )l,  +cP  (t^C)}/E  (t),  for  each  x>0.  Let 

Tx  x  x  (t  <  O  x  x 

Cj  (x)  =  c  -  c(x) ,  x ^  0;c(+ °°  )  =  0  and  note  that 

^  (x)  =  {c-E  [c  (X  )  ]  }/E  (t). 

T  X  I  T  X 

A  Markovian  replacement  time  x^  is  called  optimal  if  i^*(x)=inf 

x 

where  the  infimum  in  the  right  hand  side  is  taken  over  all  Markovian  replacement 
times . 

Let  G  Cj(x)  denote  the  inf initisemal  generator  of  the  function 

c, (x) ,b(x) = inf  ip  (x)  and  assume  that  b > 0.  Then  under  the  assumptions  of 
I  x 


the  finiteness  of  the  average  life  time  of  the  device  and  suitably  chosen 
conditions  on  the  cost  functions,  we  find  that  the  optimal  Markovian  replace¬ 
ment  policy  is  a  control  policy  of  the  form 

t*  =  inf  {t  >  0:X  e[x  ,  ®)Ac, 
x  t  x 

where 

=  inf (y:b(x)  +  Gc^(x  +  y)  ^  0} . 

The  results  reported  on  in  B  and  C  above  have  appeared  in  the  paper 
"Life  distributions  of  devices  subject  to  a  Levy  wear  process",  in 
Mathematics  of  Operations  Research. 

C) .  POSITIVE  DEPENDENCE  OF  COMPONENTS. 

The  area  of  monotone  dependence  of  multivariate  distributions  has 
attracted  the  attention  of  many  authors  over  the  past  decade.  In  this  research 
we  investigate  covariance  inequalities  for  a  class  of  multivariate  strongly 
unimodal  densities,  i.e.,  the  class  of  logarithmically  concave  densities. 

Strong  unimodal  densities  play  an  important  role  in  probability  as  well  as  in 
Statistics  since  they  enjoy  the  monotone  likelihood  ratio  property. 

For  n  = 1,2,...,  let 

H  = {f :Rn-* R:f  is  strongly  unimodal  and  symmetric) 
n  + 

A^  =  {A:A  is  nxn  diagonal  matrix  with  diagonal  elements  ±1} 

G  =  {f  e  H  :f(xA)  =  f(x)  for  all  x  e  Rn  and  all  At  A  }, 
n  n  -  -  n 

L  =(K:K  is  a  convex  symmetric  subset  of  Rn). 
n 

We  show  that  for  a  certain  class  of  unimodal  vectors  the  random  variables 


f(X)  and  g(X)  are  positively  correlated  for  all  f  and  g  in  H  .  It 

follows  in  particular  that  if  {X(t),t^0}  is  a  Wiener  process,  then  for 

each  t>0,  and  each  f,g  in  H  the  random  variables  f(X(t))  and 

n  - 

g(X(t))  are  positively  correlated.  We  also  obtain  bounds  on  the  right  tail 
probabilities  of  random  vectors  whose  densities  belong  to  classes  containing 
the  above  ones. 

Details  may  be  found  in  "Generating  Positively  Correlated  Random 
Variables  from  a  Sequence  of  Independent  Random  Variables  with  Symmetric 
Logarithmically  Concave  Densities",  UNCC-Technical  Report  (1984) 


D) .  LIFE  DISTRIBUTION  PROPERTIES  OF  DEVICES  SUBJECT  TO  A  PURE  JUMP  DAMAGE 
PROCESS. 


Suppose  that  a  device  is  subject  to  damage,  the  amount  of  damage  it 
suffers,  over  time,  is  assumed  to  be  an  increasing  pure  jump  process.  We 
denote  such  a  process  by  Xh  (X^.tX)). 

£inlar  and  Jacob  (1981)  showed  that  there  exists  a  Poisson  random 

2 

measure  on  R+ * R+  whose  mean  measure  at  the  point  (s,z)  is  dsdz/z  and 
a  deterministic  function  c  defined  on  the  positive  quadrant  that  is  in¬ 
creasin'-:  in  the  second  argument  such  that 


s 


E  f  (X 
<  t  S 


N(ds ,dz)f  (X  +  c (X  ,f)) 
s-  s- 


[  0 ,  t ] xR+ 


almost  everywhere  for  each  function  f  on  R+  *  R+  with  f(x,x)=0  for  all 
x  in  R  .  In  particular,  it  follows  that 

/ 


vv 


N'(ds,dz)c(X  ,z) . 

s- 


[  0 ,  t  |  x  R , 


The  above  formula  has  the  following  interpretation 


C  -* X  (w)  jumns  at  s  if  the  Poisson  random  measure  N(w,.)  has  an 

atom  (s,z)  and  then  the  jump  is  from  the  left-hand  limit  X  (w)  to  the 

s- 

right-hand  limit 

X  =X  +  c  (X  ,z). 
s  s-  s- 

The  function  c(x,z)  represents  the  damage  due  to  a  shock  of  magnitude  z 
occuring  at  a  time  when  the  previous  cumulative  damage  is  equal  to  x. 

Assume  that  the  device  has  a  threshold  Y  and  it  fails  once  the  damage  exceeds 
or  equal  to  Y.  The  failure  time  is  therefore  given  by 

5  =  inf(t:X  >Y). 

Let  G  be  the  right  tail  probability  of  the  random  variable  Y.  Then  the 
survival  function  is  given  by,  for  t^O, 

S(t)  =  P(S>  t) 

= E[G(Xt) ] 

We  show  that  life  distribution  properties  of  G  are  inherited  as 
corresponding  properties  of  S.  The  following  are  samples  of  some  of  the 
results  obtained: 

(1)  Theorem.  Suppose  that  the  function  c  above  satisfies  the  following 
condition 

c( .  ,z)  :R+  -►  R+  is  increasing  for  each  z^O. 

Then 

i)  S  has  increasing  failure  rate  when  G  has  increasing  failure 

rate  and  X  has  a  totally  positive  density  of  order  two; 

ii)  S  has  increasing  failure  rate  on  the  average  when  G  has  an 

increasing  failure  rate  on  the  average  and  X  has  a  totally  positive  density 


of  order  two; 


ill)  S  is  new  better  than  used  if  G  is  new  better  than  used. 

(2)  Theorem.  Suppose  that  the  function  c  satisfies  the  following  condition 

c( .  ,z) :  R+  -*■  R+  is  decreasing  for  each  z>0. 

Then 

i)  S  has  decreasing  failure  rate  when  G  has  decreasing  failure  rate 
and  X  has  a  totally  positive  density  of  order  two. 

ii)  S  has  a  decreasing  failure  rate  average  when  G  has  a  decreasing 
failure  rate  average  and  X  has  a  totally  positive  density  of  order  two. 

iii)  S  is  new  worse  than  used  when  G  is  new  worse  than  used  and  the 
function  xkx+c(x,z)  is  an  increasing  function  for  each  z^O. 

( 3 )  Theorem . 

i)  Suppose  that  G(.,t)  has  increasing  failure  rate  average  for  each 
t^O,  the  mapping  G(x,.)  is  a  decreasing  function  for  each  x^O,  X  has 
a  totally  positive  density  of  order  two,  and  c(.,z)  is  an  increasing 
function  for  each  z^O.  Then  S  has  increasing  failure  rate  average. 

ii)  Suppose  that  G(.,t)  has  a  decreasing  failure  rate  average  for 
each  t^O,  the  mapping  G(x,.)  is  an  increasing  function  for  each  x?*0, 

X  has  a  total Ly  positive  density  of  order  two  and  c(.,z)  is  a  decreasing 
function  for  each  z>0.  Then  S  has  a  decreasing  failure  rate  average. 

iii)  Suppose  that  V=  -InG  is  a  superadditive  function  on  K+  and 
c(.,z)  is  an  increasing  function  for  each  z>0.  Then  S  is  new  better 
than  used. 

iv)  Suppose  that  V  above  is  a  subadditive  function  on  R“  while  the 


function  x->x  +  c(x,z)  is  decreasing  for  each  z>0.  Then  S  is  new  worse 
than  used. 


We  also  discuss  the  optimal  replacement  problem  for  such  devices. 

Define ,  for  t  5=  0 ,  . 

I  xt  , 

z  = 

t  I 

I  +  “  ,  t  >  ? . 

The  nrocess  Z  =  (Z  )  is  obtained  by  killing  the  process  X  at  the  failure 
time  of  the  device. 

A  device  subject  to  the  damage  process  Z  can  be  replaced  before  or 
at  failure.  Each  replacement  at  failure  costs  c  dollars,  c>0.  The  cost 
of  a  replacement  before  failure  depends  on  the  damage  level  at  the  time  of 
replacement  and  is  denoted  by  c(.).  That  is  to  say,  c(x)  is  the  cost  of  a 
replacement  when  the  damage  level  at  time  of  replacement  is  equal  to  x. 
Naturally,  we  assume  that  c(x)  is  increasing  and  bounded  above  by  c.  Let 
(H^_ )  be  the  canonical  history  of  Z.  Moreover,  U  denotes  the  class  of 
stopping  times  that  do  not  exceed  the  life  time  £. 

For  any  stopping  time  x  in  U  we  let  5  denote  the  expected  cost  of 
replacement  per  unit  time.  We  are  interested  in  finding  the  stopping  time 
x*  in  Li  satisfying 


5  =  inf  5x 

S*  x  e  U 

That  is  to  say,  we  want  to  find  the  stopping  time  in  U  that  minimizes  the 
expected  cost  per  unit  time  over  U.  We  call  such  stopping  time  the  optimal 
replacement  time.  We  give  conditions  on  the  cost  function  c(x)  and  the 
damage  function  c(x,z)  that  guarantee  that  the  optimal  replacement  policy 
is  a  control-limit  policy. 


The  above  results  have  appeared  in  the  paper  entitled  "Life  distribution 
properties  of  devices  subject  to  pure  jump  damage  process".  Journal  of 
Applied  Probability. 

E) .  A  POWER  TRANSFORMATION  EXPONENTIAL  REGRESSION  MODEL  FOR  CENSORED  FAILURE 
TIME  DATA. 


Suppose  that  we  have  n  items  which  are  subject  to  failure.  Let 

k  :V  & 

T^,  T., ,...,  T  be  the  random  variables  representing  the  failure  time  of  the 
first,  second,  ...,  n  th  item  respectively.  We  assume  that  right  censoring 
may  occur  because  of  the  need  Cor  early  termination  of  the  experiment  and 

let  7. ,  T_ ,  ....  T  represent  the  recorded  survival  times.  Defining 

i  L  n 

censoring  indicator  variables 

k 

1  if  T.  is  uncensored 
i 

k 

0  if  T.  is  censored 

l 

we  have 

k  k 

T.  =  T.  if  w.  =  l  and  T.  >  T.  if  w.=0. 

li  i  ii  l 


We  let 


n  =  02  w.  and  n 


U  i=  1  1 


(1  -  w. ) 


i  =  1 


denote  the  numbers  of  uncensored  and  censored  observations  respectively. 
Without  loss  of  generality  we  label  the  individuals  such  that  the  first  n 

u 

items  have  uncensored  times  to  failure  and  the  remaining  n  have  censored 

c 

times  to  failure. 

We  now  suppose  that  measurements  are  available  on  k  explanatory 
variables  X  ,  X., ,  ...,  X  .  Setting  x' =  (x  ,  x  ,  ...,  x  ),  the 

i  i.  K  I  i-  1C 

k 

probability  density  function  and  survival  function  of  T 


Riven  x 


arc 


denoted  by  f(t;x)  and  S(t;x)  respectively.  If  the  failure  rate  does  not 

A 

depend  on  t,  for  any  given  x,  T  has  the  exponential  distribution  with 
probability  density  function 

IP ^expC-t/u  ) ,  t  >  0 

0  otherwise. 

Various  models  have  been  proposed  in  the  literature  to  represent  the 
dependence  of  on  x.  Fiegel  and  Zelew  (1965) 

Consider  the  model  from 

Px  *  (1  +  x'B) 

while  Greenberg  et  al  (1974)  use  the  form 

ux  =  X/ ( 1  +  x'  8) 

where  0/  =  (8  . ..,8, )  and  A  is  a  positive  constant.  Both  models  require 

that  the  condition  must  be  imposed  to  insure  that  p^  >  0.  An 

alternative  model  which  does  not  require  a  constraint  to  be  imposed  on  x.'_§. 
is 

Px  =  A  exp (x '£) 

This  model  arises  for  the  exponential  case  from  the  well-known  family  of 
proportional  hazard  regression  models  (see  e.g.  Kay  (1977))  in  which  an 
assumed  underlying  hazard  function  is  adjusted  by  multiplicative  exponentail 
factors  to  allow  for  the  effect  of  the  explanatory  variables,  Prentice  (1973), 
also  discusses  the  use  of  censored  regression  models  for  the  exponential  case. 
In  this  paper,  we  consider  the  power  transformation  model  given  by 

"x-S<l  +  S2'«1/S- 


* 


We  refer  to  5  as  the  power  parameter.  It  is  seen  that  when  6  =  1,  the 


model  corresponds  to  the  model  used  by  Fiegel  and  Zelew,  while  if  6  =  -1  the 
model  proposed  by  Greenberg  et  al  is  obtained  after  appropriate  renarameterisa- 
tion.  When  6 ->■  0  the  exponential  model  for  given  above  is  obtained. 

In  general,  the  power  parameter  6  as  well  as  the  coefficient  vector  8 
will  have  to  be  estimated  from  the  data.  We  obtain  maximum  likelihood 
estimators  for  these  parameters  and  it  is  shown  how  the  estimates  can  be 
obtained  using  the  statistical  package  G  LIM.  We  also  discuss  the  assessment 
of  the  goodness  of  fit  of  the  model  and  numberical  examples  are  given  to 
illustrate  the  procedure. 

Details  may  be  found  in  "A  Power  Transformation  Regression  Model  for 
Censored  Failure  Time  Data",  UNCC  -  Technical  report  (1984). 

F) .  CONSERVATIVE  AND  DISSIPATIVE  PARTS  OF  NON-MEASURE  PRESERVING  WEIGHTED 

COMPOSITION  OPERATORS. 

Earlier  joint  work  with  A.  Lambert  and  T.  Hoover  on  measure  preserving 

weighted  composition  operators  is  extended.  The  main  result  of  this  paper 

implies  that,  if  x:X->-X  is  a  measurable  transformation  of  a  probability 

space  X  onto  X  which  is  measure  isomorphic  to  a  measure  preserving 

transformation  i;:X->-X  then  there  exists  a  weight  function  <J>:X->  (0,  *  ) 

such  that  the  operator  [T.  f](x)  =  |(x)f  o  t(x)  is  conservative.  Using  this 

$ ,  x 

result,  it  is  possible  to  extend  many  results  which  were  previously  known  only 
for  measure  preserving  weighted  composition  operators  to  the  class  of  weighted 
composition  operators  whose  composition  part  is  isomorphic  to  a  measure 
preserving  transformation.  In  particular,  the  recent  characterization  of  the 
point  spectrum  for  measure  preserving  weighted  composition  operators  due  to 
A.  Lambert,  has  a  complete  analogue  for  this  wider  class.  These  results  have 


appeared  in  the  paper  "Conservative  and  dissipative  parts  of  nonmeasure 
preserving  weighted  composition  operators",  Houston  J.  Math,  8,  575-586, 
(1982). 

G) .  STABILITY  OF  OPTIMAL  STOPPING  TIMES  FOR  MARKOV  CHAINS  AND  THEIR 
APPLICATIONS  TO  OPTIMAL  REPLACEMENTS. 

With  respect  to  this  discussion,  a  Markov  Chain  is  a  discrete  time, 

homogeneous,  nonterminating  Markov  Process  with  values  in  a  state  space 

1  12  2 

(E, E) .  Two  Markov  chains  X  =  (fi,x  ,F  ,P  )  and  X  =  (0,x  ,F  ,P  )  are  said 

n  n  x  n  n  x 

to  be  (e,F  )-close  if,  for  each  xeE  and  GeF  , 
m  m 

(1  -  (-)l’1  (G)  <  P2(C)  <  (1  +  e)p’  (C)  and  (1  -  e)P2(G)  <Pl(G)  <  (1  +  e)P2(G) 

XX  X  XX  X 

where  me  {0,1,2 . ®)  and  e  is  in  [0,1).  If  G  is  a  class  of  bounded, 

real  valued  reward  functions  and  M  is  a  class  of  Markov  times,  then  X  is 

said  to  be  (F  ,C, ,M)  -  stable  (c(F  ,G,M)  -  stable)  if  for  each  a>0  and 
m  m 

ceC,  there  exists  an  e>0  and  a  8n  >  0  such  that,  if  X*  *  (0,x  ,F  ,P*) 

0  n  n  x 

is  (c,F  )-close  to  X,  then  for  any  T*  =  inf{n/g(x  )>s*(x  )  -  8} 

m  U  p  n  n 

(t.  =Lnf{n/g(x  )5=s(x  )  -  8}  is  an  (a,s)-ootimal  stooping  time  for  X((a,s*)- 
p  n  n  ' 

optimal  stopping  time  for  X^  here,  s  and  s^  are  payoffs).  Weaker 
forms  of  stability  result  if  the  conclusion  holds  only  for  8  in  some  interval 
bounded  away  from  0.  In  the  paper,  M  is  either  MF,  the  class  of  first 
entry  Markov  times,  or  it  is,  for  some  n>0,  M(n)  ,  the  class  of  stopping 
times  bounded  by  n. 

If  m  *  <*>  or  M  =  M(n),  it  is  shown  that  all  Markov  chains  are  stable 

in  a  very  strong  sense.  If  m <  °°,  then  the  (F  ,G,MF)  types  of  stability  are 

m 

equivalent  to  corresponding  (F^,G,MF)  types. 

Examples  are  given  of  chains  which  are  (F^ ,G,MF)-stable  and  c(F^,G,MF)- 
stable.  An  example  is  given  of  a  chain  that  Is  weakly  (F^ ,G,MF)-stable  and 


weakly  c (F^ ,G ,MF)-stable  but  is  not  c(F^ ,G,MF)-stable .  Finally,  an  example 
is  given  of  a  chain  and  a  reward  function  g  such  that  the  chain  is  not  stable 
in  any  (F^,{g},MF)  sense.  The  most  useful  theorem  states  that,  if  the  g  is 
a  reward  function  and  the  MF-payoff  associated  with  g  is  constant  on  the 
orbits  of  X,  then  X  is  weakly  (F^ ,{g}MF)-stable  and  weakly  c(F^ , (g) ,MF)- 
stable . 

Details  are  available  in  "On  the  stability  of  optimal  stopning  times  for 
Markov  Chains,  UNCC-Technical  Report  (1981). 

H) .  STABILITY  OF  OPTIMAL  STOPPING  TIME  AND  OPTIMAL  REPLACEMENT  PROBLEMS. 

The  investigations  are  restricted  to  stability  for  Markov  processes  which 
are  either  standard  processes  in  the  sense  of  Bluementhal  and  Gretoor  or  are 
Markov  chains.  For  optimal  stopping  times,  two  broad  classes  of  stability 
are  considered.  A  problem  (X,g)  is  considered  to  be  "c-stable",  here  X 
is  a  process  and  g  is  a  reward  function  defined  on  the  state  space  of  X, 
if  a  close  to  optimal  solution  to  the  problem  (X,g)  is  close  to  optimal  for 
any  problem  (x\g^)  which  is  sufficiently  "close"  to  the  problem  (X,g).  The 
other  broad  class  of  stability  considered  views  (X,g)  as  "stable"  if  a 
dost  to  ontimal  solution  to  the  problem  (x\g^)  is  close  to  optimal  for 
(X,g)  provided  (X^,g^)  is  "close  enough"  to  (X,g). 

One  group  of  results  characterizes  stability  of  optimal  stopping  times  in 
terms  of  a  corresponding  but  simpler  property  for  the  excessive  majorants 
associated  with  the  problems  by  the  theory.  For  example  the  following 
paraphrases  the  characterization  for  c-stability.  Here  and  below,  if  X1  is  a 
process  and  a  reward  function,  then  n\g^  will  denote  the  the  smallest 

excessive  najorant  of  g^  with  respect  to  X1. 


We  prove  the  following: 

Let  X  be  a  process  and  let  g  be  E^-measurable ,  bounded,  lower  Cq- 
continuous  and,  if  X  does  not  have  finite  lifetime,  nonnegative  and  zero 
at  A.  Then  (X,g)  is  c-stable  if  and  only  if,  for  each  xeE  and  e  >  0, 
ir^ng(x)  ^  irg(x)  +  e  whenever  X^  is  close  enough  to  X.  A  similar  result 
holds  for  stability  except  that  one  only  gets  sufficiency  and  several  technical 
assumptions  have  to  be  added.  Still,  these  results  represent  a  considerable 
reduction  of  the  problem  since  quite  a  lot  is  known  about  the  structure  of 
excessive  functions.  Also,  they  can  be  used  directly  to  show  that  the  one 
and  two  dimensional  Wiener  processes  are  stable  as  are  the  one  and  two 
dimensional  symmetric  random  walks.  They  can  also  be  used  to  show  stability 
of  the  classical  nonsymmetric  random  walks  on  the  integers  (although,  here, 
somewhat  stronger  forms  of  stability  are  obtainable). 

Another  class  of  results  concerns  stability  in  the  setting  of  finite 
lifetimes.  The  metric  used  reflects  the  closeness  of  the  lifetimes  and  very 
strong  results  are  obtained.  Essentially  in  this  setting  one  always  has 
both  kinds  of  stability  for  optimal  stopping  times.  These  results  are  shown 
to  innlv  the  stability  of  the  optimal  replacement  problem  in  the  event  that 
the  expected  values  of  the  lifetimes  are  also  finite.  Since  such  an  assumption 
is  reasonable,  this  constitutes  a  very  satisfactory  result. 

This  work  is  contained  in  "Stability  of  optimal  stopping  times  for  Markov 
processes",  UNCC  -  Technical  Report  (1982). 

I) .  AN  ITERATIVE  SCHEME  FOR  APPROXIMATING  OPTIMAL  REPLACEMENT  POLICIES. 

Let  X  =  X  ,  t^O  be  an  arbitrary  stochastic  process  with  augmented  state 
a  , 

space  E'J  and  lifetime  X = inflt [X  = A}.  We  analyze  the  following  iterative 
technique.  Let  b^  =  E^g(XX) /E^(X) .  Consider  the  problem  of  maximizing  the 


criterion  4< (b ^  ,t)  =  b^E^(r)  -  E^g(x^)  for  t<X.  If  we  are  interested  in  a 


generalized  e-optimal  policy,  then  tolerances  x>0  and  8>0  are 
determined  in  terms  of  X,g,X  and  e  so  that,  if  a  B-optimal  nolicy 


for  i[i(b^  ,t)  gives  i(/(bj,T)^a  then  X  is  already  e-optimal,  otherwise 


take  b? =  E°g(X  )/E^(x.)  and  repeat  the  steps  on  the  criterion 
T.  i 

0  0 

ij;(b9 ,t)  =  b2E  (t)  -  E  g(X^).  Under  very  reasonable  assumptions  on  g  (it  must 


be  nositive  and  bounded  away  from  zero),  it  is  shown  that  this  iterative  method 
will  supply  a  generalized  e-optimal  replacement  policy.  We  further  implement 
this  scheme  on  a  computer  for  certain  Markovian  damage  models.  Tn  doing  so,  the 


discrete  approximations  which  are  required  are  fully  justified  and  some  feeling 
for  the  speed  of  convergence  of  the  procedure  is  obtained.  The  iterative  scheme 
itself  is  very  fast.  Solving  the  related  optimal  stopping  problems  using 
dynamic  programming  techniques  is,  however,  very  slow. 

These  results  appeared  in  "An  Iterative  Scheme  for  Approximating  Optimal 
Replacement  Policies",  Reliability  Theory  and  Models,  M.S.  Abdel-Hameed , 

E.  Qinlar  and  J.  Quinn,  Editors,  Academic  Press,  New  York,  (1984). 

J) .  ACCELERATED  LIFE  TESTING  OF  SYSTEMS  WHOSE  WEAR  IS  GOVERNED  BY  A  CONTROLLED 
ODE. 

A  device  is  composed  of  a  material  with  defects,  perhaps  received  in 
manufacture.  Let  x  denote  the  size  of  a  given  defect.  Ther  is  a  threshold 
value  B  for  x  such  that  the  device  fails  when  x  =  B.  The  device  is  used 
in  an  environment  with  m-states  v  =  (s.  ,s0 , . . . ,s  ).  For  fixed  state  vector 

l  c.  m 

v,  we  assume  that  defect  size  grows  with  time  according  to  an  ODE  of  the  form 


(1) 


dx/dt  =  h(x,v)  >  0 


We  also  assume  the  existence  of  a  sigma-finite  measure  n  on  (0,B]  such  that 


n(d,B)  is  strictly  increasing  in  d, 

n(d,B)<°°  for  all  d  >  0,  and 

if  AC(0,BJ  then  inside  a  unit  quanity  of  the 

device  material  we  have  P(k  defects  belonging  to  A) = 

(n(A))k  _-n(A). 
kl —  e 

If  s.  is  the  ith  environmental  state  then 

i 

(a)  A  s.  fatigue  test  consists  of  subjecting 

the  device  to  a  fixed  s.  stress  level  until 

x 

it  fails.  Time  to  failure  is  recorded. 

(b)  A  s^  dynamic  test  consists  of  subjection  of 
the  device  to  stress  s^(t)  =  ct  for  a  constant 
c.  Stress  at  failure  is  recorded. 


Let  F^(t)  and  D^s)  denote  the  distribution  functions  for  the  fatigue  and 
dynamic  tests,  respectively.  The  0DE(1)  is  termed  s^  functionally  seperable 
if 


h(x,v)  = H(x,v^)g(x^(t))  where 

v.  (s, , . . . ,s ,  ,  ,s.  ,  . . s  ) • 

i  1  l-li+l  m 


Theorem:  The  following  are  equivalent 


(a) 

(1)  is 

s . 
i 

functionally  separable. 

(b) 

F2(t)  =  F 

2(t) 

for  different  stress  levels 

s  j  and 

S2 

and  a  constant  cCs^.s^). 

(c) 

F  L  ( t )  -  F 

2(q(t)t)  for  different  stress  levels 

s^  and 

S2 

and  a  function  q  determined  by 

s  ^  and 

s2. 

Provided  that  the  ODE  (1)  is  functionally  separable,  it  turns  out  that  the 
constant  c  can  be  determined  statistically  from  dynamic  test  data. 

Details  may  be  found  in  "Accelerated  Life  Testing  of  Systems  Whose  Wear 
is  Governed  by  a  Controlled  ODE",  UNCC  -  Technical  Report  (1986). 


K).  OPTIMAL  STOPPING  AND  REPLACEMENT  FOR  WEAR  MODELS  INCORPORATING  CONTINUOUS 
WEAR. 

T,et  X^.t^O  be  a  Markov  process  with  a  finite  state  space 
E=  (xj .x^, . . . »xn) •  While  X  is  in  state  x^,  the  wear  increases  by  jumps 
according  to  a  Levy  process  with  Levy  measure  v(x^,dy)  and  continuously  at 
a  rate  g(x^).  Thus,  if  L(x^)u  denotes  the  value  at  time  u  of  the  x^th 
Levy  process  and  X  is  in  state  x^  for  s<u<t  then  the  wear  accumulated 
over  this  time  interval  is  given  by 


is<x" 


)ia+Uxi\t-S) 


Every  change  of  state  from  x^  to  x^  is  accompanied  by  a  jump  in  damage 

determined  by  adding  to  f(x^,x^)  an  additional  random  amount  of  damage 

m(x.,x.)  with  distribution  F(x.,x.,0*  If  the  wear  starts  at  level  y_ 

1  .1  i  j  0 

and  X  jumps  at  times  0  =  t_  <  t,  <  ....  <t,  ^  t  then 

0  1  k 


To  model  wear  we  must  also  model  failure  which  involves  killing  the  wear 


process.  Here  we  restrict  ourselves  to  killing  by  a  continuously  distributed 
random  threshold  with  distribution  G,  let  G=  1  -  G.  Thus  (X^Y^)  lives 
as  long  as  Y  <  y*  where  y*  has  distribution  G. 

A  wear  model  is  termed  purely  continuous  if  it  is  of  the  form 

Vy0  +  f  8(xs)ds* 

J0 

If  an  observer  can  observe  the  whole  process  (X^jY^)  then  the  optimal 
stopping  and  replacement  theory  for  Harkov  processes  applies.  However,  we 
assume  that  only  the  second  component  is  observable.  Tn  this  case  the 
process  ceases  to  be  Markov. 

The  optimal  stopping  problem  for  purely  continuous  models  has  a  complete 
solution  and  the  optimal  policy  is  always  a  control  limit  policy. 

The  optimal  replacement  problem,  even  for  purely  continuous  models,  does 
not  have  an  implementable  0-optimal  policy. 

We  do  show,  however,  how  to  find  e-optimal  replacement  policies. 

Details  may  be  found  in  "Optimal  Stopping  and  Replacement  for  wear  models 
incorporating  continuous  wear",  UNCC  -  Technical  Report  (1986). 

L) .  OPTIMAL  REPLACEMENT  WITH  NON  CONSTANT  OPERATING  COST. 

Let  be  a  non-decreasing  Markov  process  taking  values  in 

R+ =  (0, 00 )  be  a  model  for  the  wear  of  a  device.  Let  Y  be  independent  of 
Xt:t#*0  and  take  values  in  R+.  Y  is  to  be  taken  as  a  random  threshold, 
that  is  the  device  fails  at 

o  =  inf  { t  >  0:Xt  >  Y} . 

Models  of  this  type  have  been  studied  by  amny  including  Abdel-Hameed . 


Let  f(x)>0  be  continuous  and  be  the  operating  cost  per  unit  time  when 


the  device  is  at  wear  level  x.  Let  g(x)^0  be  the  cost  of  replacing  the 
device  at  wear  level  x,  if  replacement  occurs  before  failure.  And  let 
Cq  be  the  cost  of  replacement  at  failure.  When  the  device  is  in  operation, 
at  each  moment  of  time  one  can  decide  based  upon  the  wear  level  whether  to 
stop  and  replace  the  device  by  a  new  one  or  continue  to  operate  it.  If 
failure  occurs  while  operating,  one  must  immediately  replace  the  device  by 
a  new  one.  The  decision  rules  then  are  stopping  times,  that  is  functions 


t  ft  -*■  R 


ft  =  sample  space 


subject  to  the  technical  restrictions  of 


(r<t)eF  =  o(x  :0<s^t). 
t  s 


that 


/•taB 

J-infLo  J  f<xs)ds  +  g(xT>I(T<o)  +  c0  I(t>j|)J 

The  long  run  average  optimal  replacement  problem  is  to  determine  t  so 

A 

rT  a 


\  = 


£0  /  f(xs)ds  +  8(x?)I(i<o)+c0I(->o) 

J0 


Eq[t  o]. 


Let 


Let 


Tn  explain  the  results  it  is  necessary  to  introduce  some  preliminaries. 


G(x)=P(Y<x)  and  G(x)  =  l-G(x). 


r(x)  -  Whsre  AG(x>-  U"_  Ex(G(xt)  1  ' G(x>  . 

GOO 


t  00 
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Define 


f0 /0  fb‘,4e  +'°] 


E0[o) 


(A)  VQ(x)  = 


[Ex  J  G(xt)  (f  (xt>  +  cQv(xt)  -  V)dtJ 


Result  1.  It  is  shown  that 


x=  ““  va(0) 


where  V  (x)  is  a  solution  of  a  quasi-variational  inequal  and  is  the  value 


function  of  the  discounted  optimal  replacement  problem.  Possible  numerical 


methods  are  available  for  solving  for  V  (x) 


Result  2.  In  the  case  that 


X  <  V  +  pr (x)  where 


g(0)  >  0, 


it  is  proved  that  the  optimal  policy  is 


t  =  inf{t:l/(xc)  =  G(xt)g(xt)  +  c^GCx^} 


can  be  checked  easily  since  (A)  is  compatable  given  the  model.  If 
(x:g(x)  <  Vq (x)  }  =  <{> »  then  X  =  V  and  the  do  nothing  policy  is  optimal. 

Details  of  these  results  are  in  "Long  Run  Average  Optimal  Replacement 
Problem",  UNCC  Technical  Report  (1986). 

M) .  CONFERENCE  ON1  STOCHASTIC  FAILURE  MODELS. 

In  June  1983  we  hosted  a  conference  on  Stochastic  Failure  Models.  The 
proceedings  of  this  conference  contains  many  valuable  papers  on  Reliability 
in  general  and  specifically  on  Failure  Models. 
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